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Abstract 

A  number  of  explicit  results  have  been  obtained  for  problems  of 
stochastic  control  and  stochastic  differential  games.  Stochastic  linear- 
quadratic,  continuous  time,  stochastic  control  problems  are  solved  for 
systems  with  noise  processes  that  are  arbitrary  fractional  Brownian 
motions  or  more  generally  square  integrable  continuous  processes. 
Linear-quadratic  control  problems  for  stochastic  partial  differential 
equations  with  fractional  Brownian  motions  having  the  Hurst  param¬ 
eter  in  the  interval  (1/2,1),  which  includes  the  long  range  dependent 
processes,  are  solved.  A  direct  method  for  solving  stochastic  con¬ 
trol  problems  is  given  that  does  not  require  the  solution  of  Hamilton- 
Jacobi-Bellman  equations  or  the  solution  of  backward  stochastic  dif¬ 
ferential  equations.  Both  of  these  latter  methods  present  serious  diffi¬ 
culties  for  solutions.  A  stochastic  control  problem  is  explicitly  solved 
for  a  system  that  evolves  in  the  two-sphere  which  is  useful  for  appli¬ 
cations.  Linear  exponential  quadratic  Gaussian  control  problems  for 
both  continuous  and  discrete  time  systems  are  solved  in  a  simple  di¬ 
rect  way.  Linear  exponential-quadratic  control  problems  for  stochas¬ 
tic  partial  differential  equations  are  explicitly  solved.  Discrete  time 
linear  quadratic  control  problems  for  systems  with  arbitrary  corre¬ 
lated  noise  are  explicitly  solved.  Linear-quadratic  stochastic  differ¬ 
ential  games  are  explicitly  solved  for  systems  with  arbitrary  noise. 
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Stochastic  differential  games  for  stochastic  partial  differential  equa¬ 
tions  with  fractional  Brownian  motions  are  explicitly  solved.  Ergodic 
control  problems  for  linear  exponential  quadratic  control  for  stochas¬ 
tic  partial  differential  equations  with  fractional  Brownian  motions  are 
explicitly  solved.  Stochastic  differential  games  that  evolve  in  spheres 
are  explicitly  solved.  Various  aspects  of  stochastic  adaptive  control 
are  described.  Some  linear  quadratic  control  problems  with  state  de¬ 
pendent  noise  are  explicitly  solved.  Optimal  controls  for  partially 
observed  linear  exponential  quadratic  Gaussian  control  are  obtained 
given  the  information  filter. 


1  Introduction 

This  report  provides  a  description  of  the  variety  of  results  that  were  obtained 
during  the  three  year  AFOSR  grant.  A  major  development  was  an  approach 
to  problems  of  stochastic  control  or  stochastic  differential  games  that  does 
not  require  finding  solutions  to  nonlinear  partial  differential  equations  or  solv¬ 
ing  backward  stochastic  differential  equations.  This  direct  approach  allowed 
for  the  consideration  of  stochastic  models  that  have  general  noise  processes 
and  it  allowed  for  explicit  results.  This  direct  approach  allowed  for  the  two 
researchers  supported  on  this  grant  to  consider  both  continuous  and  discrete 
time  stochastic  control  systems.  Furthermore  it  allowed  to  consider  the  con¬ 
trol  of  stochastic  partial  differential  equations  that  are  driven  by  fractional 
Brownian  motions.  The  stochastic  differential  games  that  were  solved  pro¬ 
vided  explicit  control  strategies  that  formed  Nash  equilibria. 


2  Description  of  Main  Results 

Optimal  control  problems  for  linear  stochastic  equations  with  noise  that  is 
square  integrable  with  continuous  sample  paths  and  quadratic  cost  function¬ 
als  are  solved  to  obtain  explicit  optimal  controls  [1,  3,  9,  19].  These  results 
are  significant  generalizations  of  the  well  known  linear-quadratic  Gaussian 
control  problems.  The  approach  to  obtain  explicit  optimal  stochastic  con¬ 
trols  [10]  does  not  require  solving  Hamilton- Jacobi-Bellman  partial  differen¬ 
tial  equations  or  solving  backward  stochastic  differential  equations  from  a 
stochastic  maximum  principle.  The  control  of  linear  stochastic  partial  differ¬ 
ential  equations  with  quadratic  cost,  fractional  Brownian  motions  and  inh- 
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nite  time  horizons  is  considered  where  explicit  optimal  controls  are  obtained 
[2,  17].  Optimal  controls  for  discrete  time  linear  systems  with  quadratic 
costs  and  arbitrary  correlated  noise  are  given  explicitly  in  [6].  A  variety 
of  stochastic  differential  games  are  considered  for  both  finite  and  infinite 
dimensional  linear  stochastic  systems.  Optimal  control  strategies  for  linear- 
quadratic  stochastic  differential  games  with  general  noise  processes  are  given 
explicitly  [11],  stochastic  differential  games  described  by  stochastic  partial 
differential  equations  with  fractional  Brownian  motions  are  solved  in  [12]. 
Linear-exponential-quadratic  control  for  Brownian  motion  noise  are  solved  in 
both  finite  and  infinite  dimensional  spaces  [5,  7,  8,  12,  13].  Ergodic  control 
problems  for  linear  stochastic  partial  differential  equations  with  fractional 
Brownian  motions  are  solved  in  [18].  Explicit  control  strategies  for  stochas¬ 
tic  differential  games  that  evolve  in  the  unit  sphere  in  Euclidean  three  space 
are  given  in  [4,  14,  16].  A  description  of  stochastic  adaptive  control  is  given 
in  [15].  Some  results  for  linear-quadratic  control  with  state  dependent  noise 
is  given  in  [21].  Optimal  controls  for  partially  observed  linear-exponential- 
Gaussian  control  given  the  information  filter  for  the  estimation  is  solved 
directly  in  [20]. 


References 

[1]  T.  E.  Duncan  and  B.  Pasik-Duncan,  Linear-quadratic  fractional  Gaussian 
control,  SIAM  J.  Coritrol  Optim.,  51  (2013),  4604-4619. 

[2]  T.  E.  Duncan,  B.  Maslowski  and  B.  Pasik-Duncan,  Linear-quadratic  con¬ 
trol  for  stochastic  equations  in  a  Hilbert  space  with  a  fractional  Brownian 
motion,  SIAM  J.  Control  Optim.,  50  (2012),  507-531. 

[3]  T.  E.  Duncan,  Stochastic  linear-quadratic  control  revisited,  Stochastic 
Processes,  Finance  and  Control:  A  Festschrift  in  Honor  of  Robert  J. 
Elliott  (eds.  S.  N.  Cohen,  T.  K.  Sin  and  H.  Yang)  Advances  in  Statistics, 
Probability  and  Actuarial  Sciences,  Vol.  1,  World  Scientific,  2012,  451- 
463. 

[4]  T.  E.  Duncan  and  B.  Pasik-Duncan,  A  stochastic  control  problem  in  the 
two-sphere,  Proc.  IEEE  Multiconf.  System  and  Control ,  Dubrovnik,  2012, 
1441-1444. 


3 


[5]  T.  E.  Duncan,  Linear-exponential-quadratic  Gaussian  control,  ,  IEEE 
Trans.  Autom.  Control ,  58  (2013),  2910-2911. 

[6]  T.  E.  Duncan  and  B.  Pasik-Duncan,  Discrete  time  linear  quadratic  control 
with  arbitrary  correlated  noise,  IEEE  Trans.  Autom.  Control ,  58  (2013), 
1290-1293. 

[7]  T.  E.  Duncan  and  B.  Pasik-Duncan,  Linear-exponential-quadratic  Gaus¬ 
sian  control  for  stochastic  partial  differential  equations,  Proc.  20th  Symp. 
Math.  Theory  Networks  and  Systems ,  Melbourne,  Australia,  July  2012. 

[8]  T.  E.  Duncan  and  B.  Pasik-Duncan,  Linear-exponential-quadratic  Gaus¬ 
sian  control  for  stochastic  equations  in  a  Hilbert  space,  Dyn.  Systems 
Applic.  (special  issue),  21  (2012),  407-416. 

[9]  T.  E.  Duncan  and  B.  Pasik-Duncan,  Some  models  of  control  with  frac¬ 
tional  Brownian  motions,  Proc.  9th  IFAC  Symp.  Advances  in  Control 
Education ,  Nizhny,  Russia,  June,  2012. 

[10]  T.  E.  Duncan  and  B.  Pasik-Duncan,  A  direct  method  for  solving  stochas¬ 
tic  control  problems,  Commun.  Info.  Systems  (special  issue  for  H.  F. 
Chen),  12  (2012),  1-14. 

[11]  T.  E.  Duncan,  Linear-quadratic  stochastic  differential  games  with  gen¬ 
eral  noise  processes,  Models  and  Methods  in  Economics  and  Management 
Science:  Essays  in  Honor  of  Charles  S.  Tapiero,  (eds.  F.  El  Ouardighi 
and  K.  Kogan)  ,  Operations  Research  and  Management  Series,  Springer 
Intern.  Publishing,  Switzerland,  Vol.  198,  2014,  17-26. 

[12]  T.  E.  Duncan,  Some  linear-quadratic  stochastic  differential  games  for 
equations  in  a  Hilbert  space  with  fractional  Brownian  motions,  Discrete 
Cont.  Dyn.  Systems,  Ser.  B,  2015  to  appear. 

[13]  T.  E.  Duncan  and  B.  Pasik-Duncan,  Ergodic  problems  for  linear  expo¬ 
nential  quadratic  Gaussian  control  and  linear  quadratic  stochastic  differ¬ 
ential  games,  Proc.  IEEE  Conf.  Decision  and  Control ,  2388-2492,  Firenze, 
2013. 

[14]  T.  E.  Duncan  and  B.  Pasik-Duncan,  A  solvable  stochastic  differential 
game  in  the  two-sphere,  52nd  Proc.  IEEE  Conf.  Decision  and  Control , 
7833-7837,  Firenze,  2013. 


4 


[15]  T.  E.  Duncan  and  B.  Pasik-Duncan,  Stochastic  adaptive  control,  Ency¬ 
clopedia  of  Systems  and  Control,  Springer,  2014. 

[16]  T.  E.  Duncan  and  B.  Pasik-Duncan,  Some  stochastic  differential  games 
in  spheres,  Proc.  Math.  Theory  of  Networks  and  Systems ,  Groningen,  July 
2014,  2488-2492. 

[17]  T.  E.  Duncan,  B.  Maslowski  and  B.  Pasik-Duncan,  Some  ergodic  control 
problems  for  linear  stochastic  equations  in  a  Hilbert  space  with  fractional 
Brownian  motion,  Proc.  Math.  Theory  of  Networks  and  Systems,  Gronin¬ 
gen,  July  2014,  7833-7837. 

[18]  T.  E.  Duncan,  B.  Maslowski  and  B.  Pasik-Duncan,  Ergodic  control 
of  some  linear  stochastic  partial  differential  equations  with  fractional 
Brownian  motion,  Stochastic  Analysis  and  Control,  (eds.  A.  Chojnowska- 
Michalik,  Sz.  Peszat,  L.  Stettner),  Banach  Center  Publications,  105 
(2015). 

[19]  T.  E.  Duncan  and  B.  Pasik-Duncan,  Linear-quadratic  control  with  gen¬ 
eral  noise  processes,  Proc.  53rd  Conf.  Decision  and  Control,  Dec.  2014, 
Los  Angeles,  364-369. 

[20]  T.  E.  Duncan  and  B.  Pasik-Duncan,  Some  results  on  optimal  control 
for  a  partially  observed  linear  stochastic  system  with  an  exponential 
quadratic  cost,  Proc.  IFAC  World  Congress,  Aug.  2014. 

[21]  T.  E.  Duncan  and  B.  Pasik-Duncan,  Control  of  linear  stochastic  sys¬ 
tems  with  state  dependent  noise,  Proc.  First  IFAC  Conf.  On  Modelling, 
Identification  and  Control  of  Nonlinear  Systems,  St.  Petersburg,  Russia, 
June  2015. 


5 


Response  ID:5053  Data 


1. 

1.  Report  Type 
Final  Report 
Primary  Contact  E-mail 

Contact  email  if  there  is  a  problem  with  the  report. 

duncan@ku.edu 

Primary  Contact  Phone  Number 

Contact  phone  number  if  there  is  a  problem  with  the  report 

785.864.3032 

Organization  /  Institution  name 

University  of  Kansas 

Grant/Contract  Title 

The  full  title  of  the  funded  effort. 

Adaptive  and  Optimal  Control  of  Stochastic  Dynamical  Systems 

Grant/Contract  Number 

AFOSR  assigned  control  number.  It  must  begin  with  "FA9550"  or  "F49620"  or  "FA2386". 

FA9550-1 2-1 -0384 

Principal  Investigator  Name 

The  full  name  of  the  principal  investigator  on  the  grant  or  contract. 

Tyrone  Duncan 

Program  Manager 

The  AFOSR  Program  Manager  currently  assigned  to  the  award 
Fariba  Fahroo 

Reporting  Period  Start  Date 

07/01/2012 

Reporting  Period  End  Date 

06/30/2015 

Abstract 

A  number  of  results  have  been  obtained  for  problems  of  stochastic  control  and  stochastic  differential 
games.  Stochastic  linear-quadratic,  continuous  time,  stochastic  control  problems  are  solved  for  systems 
with  noise  processes  that  are  arbitrary  fractional  Brownian  motions  or  more  generally  square  integrable 
continuous  processes.  Linear-quadratic  control  problems  for  stochastic  partial  differential  equations  with 
fractional  Brownian  motions  having  the  Hurst  parameter  in  the  interval  (1  /2,1 ),  which  includes  the  long 
range  dependent  processes,  are  solved.  A  direct  method  for  solving  stochastic  control  problems  is  given 
that  does  not  require  the  solution  of  Flamilton-Jacobi-Bellman  equations  or  the  solution  of  backward 
stochastic  differential  equations.  Both  of  these  latter  methods  present  serious  difficulties  for  solutions.  A 
stochastic  control  problem  is  explicitly  solved  for  a  system  that  evolves  in  the  two-sphere  which  is  useful  for 
applications.  Linear  exponential  quadratic  Gaussian  control  problems  for  both  continuous  and  discrete 
time  systems  are  solved  in  a  simple  direct  way.  Linear  exponential-quadratic  control  problems  for 
stochastic  partial  differential  equations  are  explicitly  solved.  Discrete  time  linear  quadratic  control  problems 
for  systems  with  arbitrary  correlated  noise  are  explicitly  solved.  Linear-quadratic  stochastic  differential 
games  are  explicitly  solved  for  systems  with  arbitrary  noise.  Stochastic  differential  games  for  stochastic 
partial  differential  equations  with  fractional  Brownian  motions  are  explicitly  solved.  Ergodic  control 
problems  for  linear  exponential  quadratic  control  for  stochastic  partial  differential  equations  with  fractional 


Brownian  motions  are  explicitly  solved.  Stochastic  differential  games  that  evolve  in  spheres  are  explicitly 
solved.  Various  aspects  of  stochastic  adaptive  control  are  described.  Some  linear  quadratic  control 
problems  with  state  dependent  noise  are  explicitly  solved.  Optimal  controls  for  partially  observed  linear 
exponential  quadratic  Gaussian  control  are  obtained  given  the  information  filter. 

Distribution  Statement 

This  is  block  12  on  the  SF298  form. 

Distribution  A  -  Approved  for  Public  Release 

Explanation  for  Distribution  Statement 

If  this  is  not  approved  for  public  release,  please  provide  a  short  explanation.  E.g.,  contains  proprietary  information. 
SF298  Form 

Please  attach  your  SF298  form.  A  blank  SF298  can  be  found  here.  Please  do  not  password  protect  or  secure  the  PDF 
The  maximum  file  size  for  an  SF298  is  50MB. 

AFOSR.SF298.pdf 

Upload  the  Report  Document.  File  must  be  a  PDF.  Please  do  not  password  protect  or  secure  the  PDF  .  The 
maximum  file  size  for  the  Report  Document  is  50MB. 

AFOSR.Fin.Rept.9.1 5.pdf 

Upload  a  Report  Document,  if  any.  The  maximum  file  size  for  the  Report  Document  is  50MB. 

Archival  Publications  (published)  during  reporting  period: 

1 .  T.  E.  Duncan  and  B.  Pasik-Duncan,  Linear-quadratic  fractional  Gaussian  control,  SIAM  J.  Control  Optim., 

51  (201 3),  4604-461 9. 

2.  T.  E.  Duncan,  B.  Maslowski  and  B.  Pasik-Duncan,  Linear-quadratic  control  for  stochastic  equations  in  a 
Hilbert  space  with  a  fractional  Brownian  motion,  SIAM  J.  Control  Optim.,  50  (201 2),  507-531 . 

3.  T.  E.  Duncan,  Stochastic  linear-quadratic  control  revisited,  Stochastic  Processes,  Finance  and  Control:  A 
Festschrift  in  Honor  of  Robert  J.  Elliott  (eds.  S.  N.  Cohen,  T.  K.  Siu  and  H.  Yang)  Advances  in  Statistics, 
Probability  and  Actuarial  Sciences,  Vol.  1 ,  World  Scientific,  201 2,  451  -463. 

4.  T.  E.  Duncan  and  B.  Pasik-Duncan,  A  stochastic  control  problem  in  the  two-sphere,  Proc.  IEEE  Multiconf. 
System  and  Control,  Dubrovnik,  201 2, 1 441  -1 444. 

5.  T.  E.  Duncan,  Linear-exponential-quadratic  Gaussian  control, ,  IEEE  Trans.  Autom.  Control,  58  (201 3), 
2910-2911. 

6.  T.  E.  Duncan  and  B.  Pasik-Duncan,  Discrete  time  linear  quadratic  control  with  arbitrary  correlated  noise, 
IEEE  Trans.  Autom.  Control,  58  (201 3),  1 290-1 293. 

7.  T.  E.  Duncan  and  B.  Pasik-Duncan,  Linear-exponential-quadratic  Gaussian  control  for  stochastic  partial 
differential  equations,  Proc.  20th  Symp.  Math.  Theory  Networks  and  Systems,  Melbourne,  Australia,  July 
2012. 

8.  T.  E.  Duncan  and  B.  Pasik-Duncan,  Linear-exponential-quadratic  Gaussian  control  for  stochastic 
equations  in  a  Hilbert  space,  Dyn.  Systems  Applic.  (special  issue),  21  (2012),  407-41 6. 

9.  T.  E.  Duncan  and  B.  Pasik-Duncan,  Some  models  of  control  with  fractional  Brownian  motions,  Proc.  9th 
IFAC  Symp.  Advances  in  Control  Education,  Nizhny,  Russia,  June,  2012. 

1 0.  T.  E.  Duncan  and  B.  Pasik-Duncan,  A  direct  method  for  solving  stochastic  control  problems,  Commun. 
Info.  Systems  (special  issue  for  H.  F.  Chen),  1 2  (201 2),  1  -1 4. 

1 1 .  T.  E.  Duncan,  Linear-quadratic  stochastic  differential  games  with  general  noise  processes,  Models  and 
Methods  in  Economics  and  Management  Science:  Essays  in  Honor  of  Charles  S.  Tapiero,  (eds.  F.  El 
Ouardighi  and  K.  Kogan) ,  Operations  Research  and  Management  Series,  Springer  Intern.  Publishing, 
Switzerland,  Vol.  1 98,  201 4, 1 7-26. 

1 2.  T.  E.  Duncan,  Some  linear-quadratic  stochastic  differential  games  for  equations  in  a  Hilbert  space  with 
fractional  Brownian  motions,  Discrete  Cont.  Dyn.  Systems,  Ser.  B,  2015  to  appear. 

1 3.  T.  E.  Duncan  and  B.  Pasik-Duncan,  Ergodic  problems  for  linear  exponential  quadratic  Gaussian  control 
and  linear  quadratic  stochastic  differential  games,  Proc.  IEEE  Conf.  Decision  and  Control,  2388-2492, 
Firenze,  2013. 

1 4.  T.  E.  Duncan  and  B.  Pasik-Duncan,  A  solvable  stochastic  differential  game  in  the  two-sphere,  52nd 


Proc.  IEEE  Conf.  Decision  and  Control,  7833-7837,  Firenze,  2013. 

1 5.  T.  E.  Duncan  and  B.  Pasik-Duncan,  Stochastic  adaptive  control,  Encyclopedia  of  Systems  and  Control, 
Springer,  2014. 

1 6.  T.  E.  Duncan  and  B.  Pasik-Duncan,  Some  stochastic  differential  games  in  spheres,  Proc.  Math.  Theory 
of  Networks  and  Systems,  Groningen,  July  201 4,  2488-2492. 

1 7.  T.  E.  Duncan,  B.  Maslowski  and  B.  Pasik-Duncan,  Some  ergodic  control  problems  for  linear  stochastic 
equations  in  a  Hilbert  space  with  fractional  Brownian  motion,  Proc.  Math.  Theory  of  Networks  and  Systems, 
Groningen,  July  2014,  7833-7837. 

1 8.  T.  E.  Duncan,  B.  Maslowski  and  B.  Pasik-Duncan,  Ergodic  control  of  some  linear  stochastic  partial 
differential  equations  with  fractional  Brownian  motion  Stochastic  Analysis  and  Control,  (eds.  A. 
Chojnowska-Michalik,  Sz.  Peszat,  L.  Stettner),  Banach  Center  Publications,  1 05  (2015). 

1 9.  T.  E.  Duncan  and  B.  Pasik-Duncan,  Linear-quadratic  control  with  general  noise  processes,  Proc.  53rd 
Conf.  Decision  and  Control,  Dec.  201 4,  Los  Angeles,  364-369. 

20.  T.  E.  Duncan  and  B.  Pasik-Duncan,  Some  results  on  optimal  control  for  a  partially  observed  linear 
stochastic  system  with  an  exponential  quadratic  cost,  Proc.  IFAC  World  Congress,  Aug.  2014. 

21 .  T.  E.  Duncan  and  B.  Pasik-Duncan,  Control  of  linear  stochastic  systems  with  state  dependent  noise, 
Proc.  First  IFAC  Conf.  On  Modelling,  Identification  and  Control  of  Nonlinear  Systems,  St.  Petersburg, 
Russia,  June  2015. 

Changes  in  research  objectives  (if  any): 

The  research  has  been  expanded  from  stochastic  control  to  include  stochastic  differential  games.  The 
problems  have  included  general  system  noise  models  and  nonlinear  stochastic  systems. 

Change  in  AFOSR  Program  Manager,  if  any: 

Extensions  granted  or  milestones  slipped,  if  any: 

AFOSR  LRIR  Number 
LRIR  Title 
Reporting  Period 
Laboratory  Task  Manager 
Program  Officer 
Research  Objectives 


Technical  Summary 

Funding  Summary  by  Cost  Category  (by  FY,  $K) 


Starting  FY 

FY+1 

FY+2 

Salary 

Equipment/Facilities 

Supplies 

Total 

Report  Document 

Report  Document  -  Text  Analysis 

Report  Document  -  Text  Analysis 

Appendix  Documents 

2.  Thank  You 

E-mail  user 

Sep  08,  2015  17:26:15  Success:  Email  Sent  to:  duncan@ku.edu 


